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Daniel T. Kaplan 

Department of Mathematics and Computer Science 
Macalester College 
St. Paul, Minnesota 55105 

§ : February 8, 2008 

o ■ 

(N 

a 



in 
o 



o 



> 



Abstract 



Abstract: Analysis of the PPF chaos control method used in biological experiments shows that it can 
robustly control a wider class of systems than previously believed, including those without stable manifolds. 
This can be exploited to find the locations of unstable periodic orbits by varying the parameters of the 
control system. 
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One of the most surprising successes of chaos theory has been in biology: the experimentally demon- 
i strated ability to control the timing of spikes of electrical activity in complex and apparently chaotic 

systems such as heart tissue and brain tissue [Q. In these experiments, PPF control — a modified 
formulation of OGY control & — was applied to set the timing of external stimuli; the controlled system 
showed stable periodic trajectories instead of the irregular interspike intervals seen in the uncontrolled 
system. The mechanism of control in these experiments was interpreted originally as analogous to that 
I of OGY control: unstable periodic orbits riddle the chaotic attractor and the electrical stimuli place the 

OO ■ system's state on the stable manifold of one of these periodic orbits. 

Alternative possible mechanisms for the experimental observations have been described by Zeng and 
Glass Q and Christini and Collins These authors point out that the controlling external stimuli 
I serve to truncate the interspike interval to a maximum value. When applied, the control stimulus sets 

■ the next interval s„+i to be on the line 



5n+ 



i = Asn + C. (1) 



pH I We will call this relationship the "control line." Zeng and Glass showed that if the uncontrolled re- 

lationship between interspike intervals is a chaotic one-dimensional function, s„+i — /(s„), then the 
control system effectively flattens the top of this map and the controlled dynamics may have fixed points 



i or other periodic orbits Q. Christini and Collins showed that behavior analogous to the fixed-point 

I control seen in the biological experiments can be accomplished even in completely random systems[^. 

Since neither chaotic one-dimensional systems nor random systems have a stable manifold, the interval- 
truncation interpretation of the biological experiments is different than the OGY interpretation. The 
interval-truncation method differs also from OGY and related control methods in that the perturbing 
control input is a fixed-size stimulus whose timing can be treated as a continuous parameter. This type 
of input is conventional in cardiology (e.g., [^). 

In this Letter, we show that the state-trunction interpretation is applicable in cases where there is 
a stable manifold of a periodic orbit as well as in cases where there are only unstable manifolds. We 
find that superior control can be achieved by intentionally placing the system's state off of any stable 
manifold. This suggests a powerful scheme for the rapid experimental identification of fixed points and 
other periodic orbits in systems where interspike intervals are of interest. 

The chaos control in Q and Q was implemented in two stages. First, interspike intervals s„ from the 
uncontrolled, "natural" system were observed. Modeling the system as a function of two variables s„+i = 
f{sn,Sn-i), the location s* of a putative unstable flip-saddle type fixed point and the corresponding 
stable eigenvalue Ag were estimated from the data.[0 (Since the fixed point is unstable, there is also an 
unstable eigenvalue A„.) The linear approximation to the stable manifold lies on a line given by Eq. 
|l| with A = \s and C — {1 — \s)s*. Second, using estimated values of A and C, the control system 
was turned on. Following each observed interval s„, the maximum allowed value of the next interspike 
interval was computed as Sn+i — Asn + C. If the next interval naturally was shorter than Sn+i no 



Figure 1: Successive images of the control line for a flip saddle with A^. = 0.3, A„ — —2.7, A — —0.1, 
and X* — s* = —.75. Left: the control line is shown as the broad dark gray line. Its image under the 
natural dynamics is shown as a dashed line; the image under the control dynamics is the bent light gray 
line. Right: the first image of the control line is replotted. The image of this under the natural dynamics 
is the dashed line; the image under the control dynamics is the solid line. 

control stimulus was applied to the system. Otherwise, an external stimulus was provided to truncate 
the interspike interval at s„+i = Sn+i- (|] 

In practice, the values of s* and for a real fixed point of the natural system are known only 
imperfectly from the data. Insofar as the estimates are inaccurate, the control system does not place the 
state on the true stable manifold. Therefore, we will analyze the controlled system without presuming 
that A and C in Eq. |^ correspond to the stable manifold. 

If the natural dynamics of the system is modeled by Sn+i = .f{sn, Sn-i), the dynamics of the con- 
trolled system is given by 



We can study the dynamics of the controlled system close to a natural fixed point, s* , by approxi- 
mating the natural dynamics linearly 0] as 



Since the controlled system (Eq. gis nonlinear even when /() is linear, it is difficult to analyze its behavior 
by algebraic iteration. Nonetheless, the controlled system can be studied in terms of one-dimensional 
maps. 

Following any interspike interval when the controlling stimulus has been applied, the system's state 
(s„, Sn-i) will lie somewhere on the control line. From this time onward the state will lie on an image 
of the control line even if additional stimuli are applied during future interspike intervals. 

Figure 1 (left) shows an example of how the dynamics result in a simple one-dimensional map for 
the case where the natural dynamics have a flip saddle {Xu < —1 and < As < 1) and where the 
control line intersects the line of identity (s„ = s„_i) below the natural fixed point s*. The stable and 
unstable manifolds are shown as arrows which intersect at the location of the natural fixed point s*. 
The control line is shown as a broad dark gray stripe. Its image under the natural dynamics is shown 
as a thin dashed line. At some points this image is above the control line and is therefore truncated 
(in the vertical direction) by the control stimulus to be on the control line. Overall, the image of the 
control line under the controlled dynamics is shown as the broad light gray bent line. In this case, the 
first, second, and all successive images of the control line are all the same: see Fig 1 (right). 

Once the control stimulus has been applied, the dynamics of the controlled system are described by 
a one-dimensional map: the bent light gray line in Fig. 1. The analysis of the dynamics of this map 
is straightforward. For the case shown in Fig. 1, the map has a fixed point (where the flat part of the 
map intersects the line of identity). Near this fixed point, the map is identical to the control line, so the 
fixed point of the map is also the "controller fixed point," 
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Figure 2: Successive images of the control line for a non-flip saddle: As — 0.3, A„ — 2.7, A — —0.1, 
X* — s* — .5. (See Fig. 1 for the key.) The stable fixed point of the controlled dynamics is located just 
to the right of the elbow in the image of the control line. 



where the control line intersects the line of identity. 

Figure 2 illustrates a more complicated case, a non-flip saddle with x* > s*, where successive images 
of the control line do not all overlap. In this case, successive images are not identical, but there is still 
a stable fixed point of the controlled dynamics at x* . 

The stability of the controlled dynamics fixed point and the size of its basin of attraction can be 
analyzed in terms of the control line and its image. When the previous interspike interval has been 
terminated by a control stimulus, the state lies somewhere on the control line. If the controlled dynamics 
are to have a stable fixed point, this must be at the controller fixed point x* where the control line 
intersects the line of identity. However, the controller fixed point need not be a fixed point of the 
controlled dynamics. For example, if the image of the controller fixed point is below the controller fixed 
point, then the interspike interval following a stimulus will be terminated naturally. 

For the controller fixed point to be a fixed point of the controlled dynamics, we require that the natural 
image of the controller fixed point be at or above the controller fixed point. One such situation, for the 
flip saddle, is illustrated in Fig. 1 where it can be seen [|oj that the natural image of a neighborhood of 
the control line near x* is above the control line. Thus the dynamics of the controlled system, close to 
a;*, are given simply by 

S„+i = ASn + C 

The fixed point of these dynamics is stable so long as — 1 < ^ < 1. In the case of a flip saddle, we 
therefore have a simple recipe for successful state-truncation control: position x* below the natural fixed 
point and set — 1 < ^ < 1. 

Fixed points of the controlled dynamics can exist for natural dynamics other than flip saddles. This 
can be seen using the following reasoning: Let ^ be the difference between the controller flxed point and 
the natural flxed point: s* = a:* -I- ^. Then the natural image of the controller flxed point can be found 
from Eq. || to be 

s„_|_i — (As + A„)a;* — AsAuX* 

+ (l + AsA, -As-A„)(a;*+0 (4) 

The condition that 

Sn+l > X* (5) 

will be satisfled depending only on As, A„, and ^ = s* — x*. In the case represented in Fig. 1, where 
f < and A„ < —1, the condition s„-|-i > x* will be satisfled for any As < 1. This means that for any 
flip saddle, so long as x* < s*, the point x* will be a flxed point of the controlled dynamics and will be 
stable so long as — 1 < ^ < 1. 

Equations ^ and |^ imply that control can lead to a stable flxed point for any type of flxed point 
except those for which both Au and As are greater than 1 (so long as — 1 < ^ < 1). Since the required 
relationship between x* and s* for a stable flxed point of the controlled dynamics depends on the 
eigenvalues, it is convenient to divide the flxed points into four classes, as given in Table | 

For example, for the non-flip saddle shown in Fig. 2, the natural image of the control line at x* is 
above x* . Thus, the controlled image will be truncated (vertically) to be identical to x* and therefore the 



Type of FP 




As 


X* Locat. 


Flip saddle 


A„ < — f 


-f < As < f 


X* < s* 


Saddle 


A„ > f 


-f < As < f 


X* > s* 


Single-flip repeller 


A„ > 1 


As < -1 


X* > s* 


Double-flip repeller 


A„ < -1 


As < -1 


X* < s* 


Spiral (complex A) 


|A„| > f 


|As| > 1 


X* < s* 



Table f : Cases which lead to a stable fixed point for the controlled dynamics. In all cases, it is assumed 
that < 1. (For the cases where As < —1, the subscript s in As is misleading in that the corresponding 
manifold is unstable. For the spiral, there is no stable manifold.) 




Figure 3: Bifurcation diagrams for the truncation controlled Henon map. Left: No noise. Right: 
Dynamical noise added (N(0,0.05)). 



controller fixed point is also a fixed point of the controlled dynamics. This will be stable for —1 < A < 1, 
but with a finite basin of attraction. 

Beyond the issue of the stability of the fixed point of the controlled dynamics, there is the question 
of the size of the fixed point's basin of attraction. Although the local stability of the fixed point is 
guaranteed for the cases in Table ^ for — 1 < ^ < 1, the basin of attraction of this fixed point may 
be small or large depending on A, C, s*, A^ and As. For the case of Fig. 1, the basin is finite when 
As + A„ — AsA,(/,4| > 1. In the case of Fig. 2, and for non-flip repellers generally, any initial condition 
that is mapped to below the As eigenvector will recced away from x*. 

The endpoints of the basin of attraction can be derived analytically [p^. The size of the basin of 
attraction will often be zero when A and C are chosen to match the stable manifold of the natural system. 
Therefore, in order to make the basin large, it is advantageous intentionally to misplace the control line 
and to put x* in the direction indicated in Table |l]. In addition, control may be enhanced by setting 
Ay^Xs, for instance ^ = 0. 

If the relationship between x* and s* is reversed from that given in Table ^ the controlled dynamics 
will not have a stable fixed points. To some extent, these can also be studied using one-dimensional 
maps. The flip saddle and double-flip repeller can display stable period-2 orbits and chaos. For the 
non-flip saddle and single-flip repeller, control is unstable when x* < s*. 

The fact that control may be successful or even enhanced when A and C are not matched to As and 
s* suggests that it may be useful to reverse the experimental procedure often followed in chaos control. 
Rather than flrst identifying the parameters of the natural unstable flxed points and then applying the 
control, one can blindly attempt control and then deduce the natural dynamics from the behavior of 
the controlled system. This use of PPF control is reminiscent of pioneering studies that used periodic 
stimulation to demonstrate the complex dynamics of biological preparations [pi] . 

As an example, consider the Henon map: 



Sn+l = 1-4 + 0.3s„_i - si 

This system has two distinct fixed points. There is a flip-saddle at s* — 0.884 with A„ = —1.924 
and As = 0.156 and a non-flip saddle at s* = —1.584 with Au = 3.26 and As = —0.092. In addition, 
there is an unstable flip-saddle orbit of period 2 following the sequence 1.366 — > —0.666 — *■ 1.366. 
There are no real orbits of period 3, but there is an unstable orbit of period 4 following the sequence 
.893 .305 1.575 —.989 — ^ .893. These facts can be deduced by algebraic analysis of the equations. 

In an experiment using the controlled system, the control parameter x* ^ C/{1 ~ A) can be varied. 
The theory presented above indicates that the controlled system should undergo a bifurcation as x* passes 
through s*. Figure 3 shows the bifurcation diagram for the controlled Henon system (with ^ = 0). For 
each value of x* , the controlled system was iterated from a random initial condition and the values of 
Sn plotted after allowing a transient to decay jl^. A bifurcation from a stable fixed point to a stable 
period 2 as x* passes through the flip-saddle value of s* = 0.884. A different type bifurcation occurs 



Figure 4: Bifurcation diagrams for the truncation controlled Henon map where truncation control is 
activated only every second (top), third (middle), or fourth (bottom) iteration. Left: No noise. Right: 
Dynamical noise added (N(0,0.05)). The locations of the true fixed points are marked with vertical lines: 
F flip-saddle; N non-flip saddle; 2 period-2 orbit; 4 period-4 orbit. 

at the non-flip saddle fixed point at s* = —1.584. To the left of the bifurcation point, the iterates are 
diverging to —oo and are not plotted. 

Adding gaussian dynamical noise (of standard deviation 0.05) does not substantially alter the bi- 
furcation diagram, suggesting that examination of the truncation control bifurcation diagram may be a 
practical way to read off the location of the unstable fixed points in an experimental preparation. 

By activating the truncation control after every second, third or fourth iteration, it is possible to find 
periodic orbits of period 2, 3, and 4 respectively. The bifurcation diagrams are shown in Fig. 4. The 
location of the period-2 orbits can be clearly discerned even in the presence of noise. No period-3 orbit 
is indicated. Noise obscures the location of all but one of the pcriod-4 points. 

Unstable periodic orbits can be difficult to find in uncontrolled dynamics because thre is typically 
little data near such orbits. Application of PPF control, even blindly, can stabilize such orbits and 
dramatically improve the ability to locate them. This, and the robustness of the control, may prove 
particularly useful in biological experiments where orbits may drift in time as the properties of the 
system change. Q 
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